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JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the 
original precisely. 

2 **** s hows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 
[Claim 1] 

It is image generation equipment which generates a static image from two or more frame 
images contained in a dynamic image, 

The criteria image generation section which compounds at least two frame images in said 
two or more frame images, and generates a criteria image, 

The object image setting section which sets up the object image which should detect the 

predetermined amount of gaps with this criteria image, 

The amount detecting element of gaps which detects said amount of gaps, 

The synthetic image generation section which compounds said object image and generates 

a synthetic image so that this amount of gaps may be compensated, 

Preparation ****** generation equipment. 

[Claim 2] 

It is image generation equipment according to claim 1, 

Said synthetic image generation section compounds said criteria image and said object 
image, and said synthetic image is generated, 
Image generation equipment. 
[Claim 3] 

It is image generation equipment according to claim 1, 

Said object image setting section sets up said two or more object images, 

Said synthetic image generation section compounds said object images, and said synthetic 

image is generated, 

Image generation equipment. 

[Claim 4] 

It is image generation equipment according to claim 3, 

Said object image setting section sets up the frame image used for generation of said 
criteria image as said object image, 
Image generation equipment. 
[Claim 5] 

It is image generation equipment according to claim 4, and is a pan, 

The evaluation section which evaluates the difference in in said criteria image and said 

synthetic image, 
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The synthetic control section which works said amount detecting element of gaps, and said 
synthetic image generation section by using said synthetic image as said criteria image 
when said difference is more than predetermined, 
Preparation ****** generation equipment. 
[Claim 6] 

It is image generation equipment according to claim 1, 

Said object image setting section chooses said object image from frame images other than 
the frame image used for generation of said criteria image, 
Image generation equipment. 
[Claim 7] 

It is image generation equipment according to claim 1, 

Said object image setting section chooses said object image from the frame image used for 
generation of said criteria image, 
Image generation equipment. 
[Claim 8] 

It is image generation equipment according to claim 7, 

Rather than said synthetic image generation section, said criteria image generation 
section is the approach in which high-speed processing is possible, and generates said 
criteria image, 

Image generation equipment. 
[Claim 9] 

It is image generation equipment according to claim 1, 

Said object image setting section compounds two or more frame images containing at least 
one frame image other than the frame image used for generation of said criteria image, 
and said object image is set up, 
Image generation equipment. 
[Claim 10] 

It is image generation equipment which generates a static image from two or more frame 
images contained in a dynamic image, 

The criteria image input section which inputs a predetermined criteria image from said 
two or more frame images, 

The object image setting section which sets up the object image which should detect the 

predetermined amount of gaps with this criteria image, 

The amount detecting element of gaps which detects said amount of gaps, 

The synthetic image generation section which compounds said criteria image and said 

object image, and generates a synthetic image so that this amount of gaps may be 

compensated, 

The synthetic control section which works said object image setting section, said amount 
detecting element of gaps, and said synthetic image generation section by using this 
synthetic image as said criteria image, 
Preparation ****** generation equipment: 
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[Claim 11] 

It is image generation equipment according to claim 1 or 10, 

Said two or more frame images are frame images which continue serially, 

Image generation equipment. 

[Claim 12] 

It is image generation equipment according to claim 1 or 10, 

Said amount of gaps contains either [ at least ] the amount of advancing-side-byside gaps, 
or the amount of rotation gaps, 
Image generation equipment. 
[Claim 13] 

It is the image generation method which generates a static image from two or more frame 
images contained in a dynamic image, 

(a) The process which compounds at least two frame images in said two or more frame 
images, and generates a criteria image, 

(b) The process which sets up the object image which should detect the predetermined 
amount of gaps with this criteria image, 

(c) The process which detects said amount of gaps, 

(d) The process which compounds said object image and generates a synthetic image so 
that this amount of gaps may be compensated, 

Preparation ****** generation method. 
[Claim 14] 

It is the image generation method which generates a static image from two or more frame 
images contained in a dynamic image, 

(a) The process which acquires a predetermined criteria image from said two or more 
frame images, 

(b) The process which sets up the object image which should detect the predetermined 
amount of gaps with this criteria image, 

(c) The process which detects said amount of gaps, 

(d) The process which compounds said criteria image and said object image, and generates 
a synthetic image so that this amount of gaps may be compensated, 

(e) The process which generates said synthetic image by said process (b) thru/or (d) by 
using this synthetic image as said criteria image, 

Preparation ****** generation method. 
[Claim 15] 

It is a computer program for controlling the image generation equipment which generates 
a static image from two or more frame images contained in a dynamic image, 
The function which compounds at least two frame images in said two or more frame 
images, and generates a criteria image, 

The function to set up the object image which should detect the predetermined amount of 

gaps with this criteria image, 

The function to detect said amount of gaps, 
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The function which compounds said object image and generates a synthetic image so that 

this amount of gaps may be compensated, 

The computer program for realizing a computer. 

[Claim 16] 

It is a computer program for controlling the image generation equipment which generates 

a static image from two or more frame images contained in a dynamic image, 

The function which acquires a predetermined criteria image from said two or more frame 

images, 

The object image setting up function which sets up the object image which should detect 

the predetermined amount of gaps with this criteria image, 

The amount detection function of gaps to detect said amount of gaps, 

The synthetic image generation function which compounds said criteria image and said 

object image, and generates a synthetic image so that this amount of gaps may be 

compensated, 

The function which generates said synthetic image by using this synthetic image as said 
criteria image by said object image setting up function, said amount detection function of 
gaps, and said synthetic image generation function, 
The computer program for realizing a computer. 
[Claim 17] 

The record medium recorded possible [ computer reading of a computer program according 
to claim 15 or 16 ]. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] 

This invention relates to the technique which generates a static image from two or more 

frame images contained in a dynamic image. 

[0002] 

[Description of the Prior Art] 

Carrying out the capture of the one scene of the dynamic image photoed with the digital 
video camera etc., and generating the static image of high resolution rather than a frame 
image conventionally, is performed. Such a static image is generated by piling up and 
compounding two or more frame images contained in a dynamic image. 
[0003] 

For example, one frame image is chosen as the patent reference 1 from the frame image of 
continuous ** (n+l) as a criteria image, the motion vector of other n frame images (object 
image) to this criteria image is computed, respectively, and the technique which 
compounds the frame image of** (n+l), and generates a static image is indicated based on 
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each motion vector. 
[0004] 

[Patent reference l] 

JP,2000-244851,A 

[0005] 

[Problem(s) to be Solved by the Invention] 

However, generally many noises are contained in each frame image by factors, such as 
compression. And the precision of the amount detection of gaps worsens, so that a noise 
becomes large. For this reason, with the technique of the patent reference 1 shown 
previously, there was a case where the image quality of the static image generated 
worsened. 
[0006] 

This invention is made in order to solve an above-mentioned technical problem, and it aims 
at raising the image quality of the static image generated from two or more frame images 
contained in a dynamic image. 
[0007] 

[The means for solving a technical problem, and its operation and effectiveness] 

In order to solve a part of above-mentioned technical problem [ at least ], the following 

configurations were adopted in this invention. 

1st image generation equipment of this invention, 

It is image generation equipment which generates a static image from two or more frame 
images contained in a dynamic image, 

The criteria image generation section which compounds at least two frame images in said 
two or more frame images, and generates a criteria image, 

The object image setting section which sets up the object image which should detect the 

predetermined amount of gaps with this criteria image, 

The amount detecting element of gaps which detects said amount of gaps, 

The synthetic image generation section which compounds said object image and generates 

a synthetic image so that this amount of gaps may be compensated, 

Let preparation ****** be a summary. 

[0008] 

Here, it is the static image which can be displayed with a progressive method (it is also 
called a non-interlace method) as a frame image. Therefore, in the case of an interlace 
method, the image which consists of two or more field images (odd number field and even 
number field) with which rasters differ is equivalent to the frame image of this invention. 
[0009] 

In this invention, a criteria image is an image which compounded at least two frame 
images. The noise contained in each frame image is equalized, and it has stopped therefore, 
being conspicuous. By shifting considering this as a criteria image and detecting an 
amount, the precision can be raised and the image quality of the static image generated 
can be raised. 
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[0010] 

In addition, a criteria image may be an image which compounded the continuous frame 
image, and may be an image which compounded the discontinuous frame image. 
[0011] 

Moreover, ****************** the bilinear method, and the well-known various technique, 
such as bicubic, are applicable to synthetic processing of an image which the criteria image 
generation section and the synthetic image generation section perform. Moreover, it may 
be made to perform synthetic processing that the criteria image generation section and the 
synthetic image generation section are the same, and may be made to perform processing 
different, respectively. 
[0012] 

In the 1st image generation equipment of this invention, 

Said synthetic image generation section compounds said criteria image and said object 

image, and can generate said synthetic image. 

[0013] 

The image quality of a synthetic image can be raised by carrying out like this. 
[0014] 

Moreover, it sets to the 1st image generation equipment of this invention, 

Said object image setting section sets up said two or more object images, 

Said synthetic image generation section compounds said object images, and can generate 

said synthetic image. 

[0015] 

This is a mode which does not compound a criteria image to the generate time of a 
synthetic image. The image quality of a static image can be raised also by carrying out like 
this. 
[0016] 

In the above-mentioned image generation equipment, 

Although said object image setting section can set up the frame image of arbitration as an 
object image, it is desirable to set up the frame image used for generation of said criteria 
image as said object image. 
[0017] 

For example, when n frame images are compounded and a criteria image is generated, it is 
the mode which uses all these n frame images as an object image. Since the amount of gaps 
with a criteria image can generate a synthetic image by carrying out like this, using 
comparatively few frame images as an object image, the image quality of a static image can 
be raised. 
[0018] 

It sets to the above-mentioned image generation equipment, and is a pan, 

The evaluation section which evaluates the difference in in said criteria image and said 

synthetic image, 

The synthetic control section which works said amount detecting element of gaps, and said 
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synthetic image generation section by using said synthetic image as said criteria image 
when said difference is more than predetermined, 
It is good as for a method of ********. 
[0019] 

This is a mode which repeats generation of a synthetic image and performs it until the 
difference between a criteria image and a synthetic image becomes under predetermined. 
Evaluation of the difference between a criteria image and a synthetic image can be 
performed by computing the difference and the ratio of a gradation value of each pixel to 
which both correspond. By this invention, the image quality of a static image can be raised 
further. 
[0020] 

In the 1st image generation equipment of this invention, 

Said object image setting section can choose said object image from frame images other 

than the frame image used for generation of said criteria image. 

[0021] 

By carrying out like this, a synthetic high definition image is generable with reference to 

many frame images. 

[0022] 

Moreover, you may make it said object image setting section choose said object image from 

the frame image used for generation of said criteria image. 

[0023] 

These can be reduced when noises, such as so-called block noise, so-called mosquito noise, 
etc., are contained in a criteria image and an object image by carrying out like this. 
[0024] 

In the above-mentioned image generation equipment, 

Said criteria image generation section is the approach in which high-speed processing is 
possible, and you may make it generate said criteria image rather than said synthetic 
image generation section. 
[0025] 

The technique of image interpolation is used for composition of an image. Generally, since 
the procedure is simplified, the approach in which high-speed processing is possible has a 
bad interpolation precision, and is inferior to an approach with a complicated procedure in 
image quality. For example, a procedure becomes complicated in this sequence and, as for 
******************^ bilinear method, and bicubic, the processing time becomes long. 
On the other hand, interpolation precision becomes high and image quality improves. 
[0026] 

In this invention, to be high definition is not necessarily demanded as compared with the 
synthetic image generated in the synthetic image generation section since it is the image 
used in order to detect the amount of gaps of an object image while a criteria image is an 
image compounded in the synthetic image generation section. Therefore, for example, 
****************** ^ n high-speed processing is possible can be applied to generation 
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of a criteria image, and the bilinear method interpolation precision is high can be applied 
to generation of a synthetic image. By this invention, since between the generate times of a 
criteria image can be shortened, between the generate times of a static image can be 
shortened. 
[0027] 

In addition, it sets to the 1st image generation equipment of this invention, 

Said object image setting section compounds two or more frame images containing at least 

one frame image other than the frame image used for generation of said criteria image, 

and you may make it set up said object image. 

[0028] 

This is a mode which also uses an object image as the image which compounded two or 
more frame images. That is, the synthetic image generation section compounds the criteria 
image and object image with which two or more frame images were compounded, and 
generates a synthetic image. The image quality of a static image can be raised also by 
carrying out like this. 
[0029] 

2nd image generation equipment of this invention, 

It is image generation equipment which generates a static image from two or more frame 
images contained in a dynamic image, 

The criteria image input section which inputs a predetermined criteria image from said 
two or more frame images, 

The object image setting section which sets up the object image which should detect the 

predetermined amount of gaps with this criteria image, 

The amount detecting element of gaps which detects said amount of gaps, 

The synthetic image generation section which compounds said criteria image and said 

object image, and generates a synthetic image so that this amount of gaps may be 

compensated, 

The synthetic control section which works said object image setting section, said amount 
detecting element of gaps, and said synthetic image generation section by using this 
synthetic image as said criteria image, 
Let preparation ****** be a summary. 
[0030] 

By carrying out like this, a criteria image and an object image can be compounded 
gradually and a synthetic image can be generated. The noise contained in a criteria image 
and an object image is equalized, and it has stopped therefore, being conspicuous by the 
synthetic image. By shifting considering this as a criteria image and detecting an amount, 
the precision can be raised and the image quality of the static image generated can be 
raised. 
[0031] 

In addition, it sets to the 1st [ of this invention ], or 2nd image generation equipment, 
Said two or more frame images have [ making it be the frame image which continues 



8/19 



Japanese Publication number : 2004-272751 A 



serially ] desirable things. 
[0032] 

By carrying out like this, the amount of gaps of a criteria image and an object image can be 

stopped comparatively small. 

[0033] 

Moreover, it sets to the 1st [ of this invention ], or 2nd image generation equipment, 
As for said amount of gaps, it is desirable to make it either [at least ] the amount of 
advancing- side -by side gaps or the amount of rotation gaps included. 
[0034] 

The amount of advancing-side-by-side gaps is detectable with various technique, such as a 
block matching method, a gradient method, and the technique of having combined these. 
The amount of rotation gaps is also detectable with geometric count. By this invention, the 
amount of gaps can be detected with a sufficient precision, and a synthetic image can be 
generated. 
[0035] 

In addition, combination is possible for the 1st and 2nd image generation equipment 

explained above suitably in the part. 

[0036] 

This invention can also be constituted as invention of an image generation method besides 
the configuration as above-mentioned image generation equipment. Moreover, it is 
possible to realize in various modes, such as a computer program which realizes these and 
a record medium which recorded the program, and a data signal embodied in the 
subcarrier including the program. In addition, in each mode, it is possible to apply the 
various additional elements shown previously. 
[0037] 

When it constitutes this invention as a record medium which recorded a computer program 
or its program, it is good also as what is constituted as the whole program which controls 
actuation of image generation equipment, and good also as what constitutes only the part 
which achieves the function of this invention. Moreover, the various media as a record 
medium which computers, such as internal storage (memory, such as RAM and ROM), 
external storage, etc. of printed matter and a computer with which signs, such as a flexible 
disk, CD-ROM and DVD-ROM, a magneto-optic disk, an IC card, a ROM cartridge, a 
punch card, and a bar code, were printed, can read can be used. 
[0038] 

[Embodiment of the Invention] 

Hereafter, the gestalt of operation of this invention is explained in order of the following 
based on an example. 
A. The 1st example • 

Configuration of Al. image generation equipment - 
Generation of an A2. static image - 
Detection of the amount of A3, gaps • 
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A4. composition : 

A5. static-image generation processing ' 

B. The 2nd example • 

Configuration of Bl. image generation equipment ' 

Generation of B-2. static image * 

B3. static-image generation processing : 

C. Modification • 
[0039] 

A. The 1st example * 

Configuration of Al. image generation equipment * 

Drawing 1 is the explanatory view showing the outline configuration of the image 
generation equipment 100 as the 1st example of this invention. This image generation 
equipment 100 is equipment which compounds two or more frame images contained in a 
dynamic image, and generates the static image of high resolution rather than a frame 
image. Image generation equipment 100 is constituted by installing predetermined 
application software in a general-purpose personal computer, and is equipped with each 
functional block to illustrate by software. 
[0040] 

The personal computer is equipped with the interface for inputting a dynamic image from 
record media, such as CPU, ROM, a hard disk besides RAM, and DVD-ROM, a memory 
card, etc. Moreover, it also has the function which reproduces the inputted dynamic image. 
[0041] 

A control section 10 controls each part. The frame image input section 20 inputs the frame 
image contained in a dynamic image. In this example, the frame image input section 20 
shall input four frame images which continue serially from the timing as which the user 
inputted directions of a halt during playback of a dynamic image in the command input 
area which does not illustrate. A user may enable it to set the number of the frame images 
which the frame image input section 20 inputs as arbitration. Moreover, the frame image 
to input does not need to be continuing serially. The frame image storage section 30 
memorizes two or more frame images which the frame image input section 20 inputted. 
[0042] 

The criteria image selection section 40 chooses a criteria image from two or more frame 
images memorized by the frame image storage section 30. In this example, the frame 
image input section 20 shall choose the frame image inputted first as a criteria image. 
About two or more frame images of each, functional block for analyzing the characteristic 
quantity (for example, edge reinforcement etc.) is formed, and it may be made to choose a 
criteria image in image generation equipment 100 based on an analysis result. 
[0043] 

The object image setting section 50 sets up the object image set as the detection object of 
the amount of gaps with a criteria image. In this example, it shall be set as the order into 
which the frame image input section 20 inputted three frame images after a criteria image 
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as an object image so that it may mention later. 
[0044] 

The amount detecting element 60 of gaps detects the amount of gaps of the object image to 
a criteria image. In this example, the amount of advancing-side-by-side gaps and the 
amount of rotation gaps shall be detected as an amount of gaps. About detection of this 
amount of gaps, it mentions later. 
[0045] 

The synthetic image generation section 70 compounds a criteria image and an object image, 
and generates a synthetic image so that the amount of gaps which the amount detecting 
element 60 of gaps detected may be compensated, while it performs resolution conversion. 
About the synthetic approach of a criteria image and an object image, it mentions later. 
[0046] 

Generation of an A2. static image ♦ 

Drawing 2 is the explanatory view showing notionally signs that compound two or more 
frame images and a static image is generated in the 1st example. As explained previously, 
in this example, a static image is generated using four frame images which continue 
serially. 
[0047] 

First, both amount of gaps is detected by using the frame image 2 as an object image, using 
the top frame image 1 as a criteria image, these are compounded, and the synthetic image 
1 is generated. Next, both amount of gaps is detected by using the frame image 3 as an 
object image, using the synthetic image 1 as a criteria image, these are compounded, and 
the synthetic image 2 is generated. Next, both amount of gaps is detected by using the 
frame image 4 as an object image, using the synthetic image 2 as a criteria image, these 
are compounded, and the synthetic image 3 is generated. A static image is generated 
through such a process. Hereafter, detection and the synthetic approach of the amount of 
gaps of a criteria image and an object image are explained. 
[0048] 

Detection of the amount of A3, gaps • 

Drawing 3 is the explanatory view showing the amount of gaps of a criteria image and an 
object image. The coordinate (xl, yl) of a criteria image shall have shifted to the coordinate 
(x2, y2) of an object image. In this example, the amount of advancing-side-byside gaps (u, 
v) and the amount delta of rotation gaps shall be used as an amount of gaps. 
[0049] 

In this example, the amount of advancing- side -by-side gaps of a criteria image and an 
object image shall be calculated with a gradient method. Drawing 4 is the explanatory view 
showing the calculation approach of the amount of advancing-side-byside gaps by the 
gradient method. The pixel and brightness of a criteria image and an object image were 
shown in drawing 4 (a). In drawing 4 (a), (xli, yli) express the coordinate value of the pixel 
of a criteria image, and Bl (xli, yli) expresses the brightness. Moreover, the principle of a 
gradient method was shown in drawing 4 (b). 
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[0050] 

here - the pixel of the coordinate (x2i, y2i) of an object image •* the coordinate between the 
coordinates Gel i-xli+1, yl i-yli+l) of a criteria image (i.e., between pixels) - it is Gel 
i+delta x, yli+deltay) it explains as what existing. 
[0051] 

Be shown in drawing 4 (b), 
Px=Bl(xli+l, yli)-Bl (xli, yli) ... (l) 
Py=BlGcli, yli+l)Bl (xli, yli) ... (2) 
It carries out, 
B1=B1 (xli, yli) ... (3) 
B-2=B-2 (x2i, y2i) ... (4) 
It is, when it carries out, 
Pxdelta x=B-2-Bl ... (5) 
Py-delta y=B-2Bl ... (6) 
****** is realized. It follows, 
{Px-delta x- (B-2-B1)} 2= 0 ... (7) 
{Px delta y- (B-2B1)} 2= 0 ... (8) 

What is necessary is just to ask for ******** deltax and delta y. In fact, deltax and delta y 

will be computed about each pixel, and an average will be taken on the whole. 

[0052] 

And when the both directions of x directions and the direction of y are taken into 
consideration, it is, 

S2=sigma {Px delta x+Pydelta y- (B2B1)} 2 ... (9) 

What is necessary is just to ask for deltax and delta y which are made into min. 
[0053] 

In addition, although the amount of advancing-side-byside gaps shall be computed with a 
gradient method, you may make it use other technique, such as a block matching method, 
a repetitive gradient method, and the technique of having combined these, in this example. 
[0054] 

Drawing 5 is the explanatory view showing the calculation approach of a rotation gap. 
Here, the advancing-side-by-side gap with a criteria image and an object image shall be 
amended. 
[0055] 

They are r and theta, if distance from the zero O of the coordinate (xl, yl) of a criteria 

image is set to r and angle of rotation from a x axis is set to theta, 

r=(xl2+yl2) 1/2 ... (10) 

Theta=tan ■ 1 (x 1/y 1) . . . ( 1 1) 

It becomes. 

[0056] 

Movement magnitude of the direction of a x axis by this rotation, and the yaxis approach if 
it is the coordinate (x2, y2) and match of an object image here when only an include angle 
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delta rotates the coordinate (xl, yl) of a criteria image centering on Zero O, 

x2-xl**-r-delta-sin theta=-delta-y 1 ... (12) 

y2-yl** r-delta-cos theta=delta-x 1 ... (13) 

It asks "Be alike." 

[0057] 

Therefore, deltax and delta y in the above-mentioned formula (9), 

delta x=u-delta*y 1 ... (14) 

delta y=v+delta-x 1 ... (15) 

It can express. 

[0058] 

If these are substituted for the above-mentioned formula (9), 
S2=sigma {Px, +Py, and (v+delta-x 1) - (B-2-B1)} 2 ... (16) 

********** 

■ 

[0059] 

The amount of advancingside-by-side gaps and the amount of rotation gaps of less than 1 
pixel of a criteria image and an object image are detectable with a sufficient precision by 
asking for u, v, and delta which make min S2 of the above-mentioned formula (16) with the 
least square method. 
[0060] 

A4. composition ' 

Drawing 6 is the explanatory view showing the synthetic approach of a criteria image and 
an object image. Signs that amended the amount of gaps on the upper case of drawing 6 , 
and the criteria image and the object image had been arranged on it were shown. The 
physical relationship of each pixel of a criteria image, an object image, and a synthetic 
image was shown in the lower berth of drawing 6 . In the lower berth of drawing 6 , "O" 
expresses the pixel of a criteria image. expresses the pixel of an object image. The round 
mark which attached hatching on the grid of a broken line expresses the pixel of a 
synthetic image. In addition, resolution of a criteria image and an object image is made the 
same, and this drawing shows the case where the resolution of a frame image is increased 
by 1.5 times in the direction of a x axis, and the direction of the y-axis. 
[0061] 

Here, its attention is paid to the pixel gl of a synthetic image. This pixel gl is in agreement 
with the pixel tl of a criteria image. In this case, the gradation value of a pixel gl is 
determined by calculating the gradation value in the location of a pixel gl by the bilinear 
method, and averaging this gradation value and the gradation value of the pixel tl of a 
criteria image based on the gradation value of four pixels sl~s4 of the object image 
surrounding a pixel gl. 
[0062] 

Moreover, the following procedures determine the gradation value of the pixel g2 of a 
synthetic image. That is, based on the gradation value of four pixels t2-t5 of the criteria 
image surrounding a pixel g2, the gradation value in the location of an image g2 is first 
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calculated by the bilinear method. Next, based on the gradation value of four pixels s4*s7 of 
the object image surrounding a pixel g2, the gradation value in the location of a pixel g2 is 
calculated by the bilinear method. And the gradation value of a pixel g2 is determined by 
averaging both. 
[0063] 

About other pixels, a gradation value can be determined the same with having explained 
above. What is necessary is here, to have explained as what has the the same resolution of 
a criteria image and an object image, in order to make an understanding easy, but to 
expand or reduce and just to perform same processing suitably, when the resolution of a 
criteria image and an object image differs. 
[0064] 

In addition, in this example, although a synthetic image shall be generated using the 

bilinear method, other technique, such as bicubic, may be applied. 

[0065] 

A5. static-image generation processing : 

Drawing 7 is a flow chart which shows the flow of the static-image generation processing in 
the 1st example. It is the processing which CPU of image generation equipment 100 
performs. 
[0066] 

First, a criteria image is acquired from the frame image storage section 30 (step S100). As 
explained previously, in this example, the frame image input section 20 shall use as a 
criteria image the frame image inputted first. Next, an object image is set up (step SI 10). 
And the amount of gaps of the object image to a criteria image is detected (step S120), and 
a synthetic image is generated so that this amount of gaps may be compensated (step 
S130). And it judges whether generation of a synthetic image was completed about the 
frame images of all four sheets which the frame image input section 20 inputted (step 
S140). 
[0067] 

In step S140, when generation of a synthetic image is completed about no frame images, 
the synthetic image generated in step S130 is set up as a criteria image (step S150), and 
steps S110-S140 are performed. In step S140, when generation of a synthetic image is 
completed about all frame images, generation processing of a static image is ended. 
[0068] 

According to the image generation equipment of the 1st example explained above, a 
criteria image and an object image can be compounded gradually and a synthetic image 
can be generated. The noise contained in a criteria image and an object image is equalized, 
and it has stopped therefore, being conspicuous by the synthetic image. By shifting 
considering this as a criteria image and detecting an amount, the precision can be raised 
and the image quality of the static image generated can be raised. 
[0069] 

B. The 2nd example * 
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Configuration of Bl. image generation equipment : 

Drawing 8 is the explanatory view showing the outline configuration of image generation 
equipment 100A as the 2nd example of this invention. The configuration of image 
generation equipment 100A is almost the same as the image generation equipment 100 of 
the 1st example except having the evaluation section 80. In addition, in the 2nd example, 
the generation method of a static image differs from the 1st example so that it may explain 
below. For this reason, the evaluation section 80 estimates the difference in 2 composition 
images so that it may mention later. 
[0070] 

Generation of B-2. static image • 

Drawing 9 is the explanatory view showing notionally signs that compound two or more 
frame images and a static image is generated in the 2nd example. A static image shall be 
generated like the 1st example using four frame images which continue serially. 
[0071] 

First, each amount of gaps of a criteria image and an object image is detected using a 
criteria image and the three frame images 2-4 as an object image for the frame image 1, 
the four frame images 1-4 are compounded, and the synthetic image 1 is generated. Next, 
each amount of gaps is detected by using the frame images 1*4 as an object image, using 
the synthetic image 1 as a criteria image, the frame images 1*4 are compounded, and the 
synthetic image 2 is generated. In addition, the synthetic image 1 as a criteria image is not 
compounded with an object image at this time. You may make it compound the synthetic 
image 1 and an object image. 
[0072] 

This example estimates the difference between the synthetic image 1 and the synthetic 
image 2, in order to raise the image quality of a static image further. It shall ask for the 
difference of the gradation value of each pixel of the synthetic image 1 and the synthetic 
image 2, and this example shall estimate the difference between the synthetic image 1 and 
the synthetic image 2 based on the sum of squares. If the sum of squares of both difference 
is beyond a predetermined value, it judges that the image quality of the synthetic image 2 
is inadequate, and further, each amount of gaps will be detected by using the frame images 
1-4 as an object image, using the synthetic image 2 as a criteria image, the frame images 
1-4 will be compounded, and the synthetic image 3 will be generated. And the difference 
between the synthetic image 2 and the synthetic image 3 is evaluated again. In addition, a 
predetermined value can be set as arbitration. 
[0073] 

such a process -- the above ■■ it carries out repeatedly until the sum of squares of difference 
becomes under a predetermined value (i.e., until it becomes impossible to expect 
improvement in image quality according to the above-mentioned process), and a static 
image is generated. In addition, the detection approach of the amount of gaps of a criteria 
image and an object image and the synthetic approach of the frame images 1-4 are almost 
the same as the 1st example, moreover - this example — the difference between the 
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synthetic image n and a synthetic image (n+l) - the above " although the sum of squares 

of difference shall estimate, it is good also as what is evaluated by both ratio. 

[0074] 

B3. static-image generation processing ' 

Drawing 10 is a flow chart which shows the flow of the staticimage generation processing 
in the 2nd example. It is the processing which CPU of image generation equipment 100A 
performs. 
[0075] 

First, a criteria image is acquired from the frame image storage section 30 (step S200). Let 
the frame image which the frame image input section 20 inputted first be a criteria image 
like the 1st example also in the 2nd example. Next, an object image is set up (step S210). 
Here, as explained previously, three frame images except a criteria image are set up as an 
object image. And a criteria image and the object image of three sheets are compounded, 
and a synthetic image is generated so that each amount of gaps of a criteria image and the 
object image of three sheets may be detected (step S220) and each amount of gaps may be 
compensated (step S230). in addition, bilinear [ in step S230 / like the 1st example / to 
generation of a synthetic image ] in this example " bilinear, although law shall be applied 
- it is good also as what a procedure is simplified and applies ****************** j n which 
high-speed processing is possible rather than law. By carrying out like this, between the 
generate times of a static image can be shortened rather than the case where only the 
bilinear method is used. 
[0076] 

Next, four frame images which set up the synthetic image generated at step S230 as a 
criteria image (step S240), and were used for generation of this criteria image (synthetic 
image) are set up as an object image (step S250). And the object image of four sheets is 
compounded and a synthetic image is generated so that each amount of gaps of a criteria 
image and the object image of four sheets may be detected (step S260) and each amount of 
gaps may be compensated (step S270). 
[0077] 

Next, the difference of the gradation value of each pixel and its sum of squares of the 
synthetic image generated at step S230 and the synthetic image generated at step S270 
are computed (step S280). And it judges whether the sum of squares of difference is under 
a predetermined value (step S290). 
[0078] 

step S290 -- setting - the above " when the sum of squares of difference is beyond a 
predetermined value, steps S240-S290 are performed further. In this case, in step S280 of 
the 2nd henceforth, the sum of squares of the difference of the synthetic images (the last 
synthetic image and this synthetic image) generated at step S270 is computed, step S290 - 
setting - the above -- when the sum of squares of difference is under a predetermined 
value, generation processing of a static image is ended. 
[0079] 
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In image generation equipment 100A of the 2nd example explained above, a criteria image 
is an image which compounded at least two frame images. The noise contained in each 
frame image is equalized, and it has stopped therefore, being conspicuous. By shifting 
considering this as a criteria image and detecting an amount, the precision can be raised 
and the image quality of the static image generated can be raised. 
[0080] 

C. Modification - 

As mentioned above, although the gestalt of some operations of this invention was 
explained, operation in the mode which becomes various within limits which are not 
limited to the gestalt of such operation at all, and do not deviate from the summary is 
possible for this invention. For example, the following modifications are possible. 
[0081] 

CI. modification 1 : ' ' 

The image generation equipment 100 of the 1st example of the above can also generate a 
panorama image. Drawing 11 R> 1 is the explanatory view showing the situation of 
panorama image generation. Here, the five frame images 1-5 shown as the continuous line 
were compounded, the part was extracted, and the case where the panorama image shown 
with the broken line was generated was shown. With the conventional image generation 
equipment explained previously, since there was no field which laps with the frame image 
5 when the frame image 1 is used as a criteria image, generation of a synthetic image was 
not completed. Since according to the image generation equipment 100 of the 1st example 
sequential generation of the synthetic image is carried out and it considers as a criteria 
image, it is possible to compound more frame images and to generate a panorama image. 
[0082] 

C2. modification 2 ■ 

Although a synthetic image shall be generated in the 1st example of the above according to 
the sequence of the continuous frame image which the frame image input section 20 
inputted, it is not restricted to this. For example, the frame image 1 and the frame image 3 
are compounded, and you may make it generate the synthetic image 1 in drawing 2 . The 
image quality of a static image can be raised also by carrying out like this. 
[0083] 

C3. modification 3 * 

Although a frame image shall be set up as an object image in the above-mentioned example, 
it is good also as what sets up the image which compounded two or more frame images. In 
this case, two or more frame images containing at least one frame image other than the 
frame image used for generation of a criteria image may be compounded and set up, and 
two or more frame images which are not used for generation of a criteria image may be 
compounded and set up. The image quality of a static image can be raised also by carrying 
out like this. 

[Brief Description of the Drawings] 

[Drawing l] It is the explanatory view showing the outline configuration of the image 
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generation equipment 100 as the 1st example of this invention. 

[Drawing 2] In the 1st example, it is the explanatory view showing notionally signs that 
compound two or more frame images and a static image is generated. 

[Drawing 3] It is the explanatory view showing the amount of gaps of a criteria image and 
an object image. 

[Drawing 4] It is the explanatory view showing the calculation approach of the amount of 
advancing-side-by-side gaps by the gradient method. 

[Drawing 5] It is the explanatory view showing the calculation approach of a rotation gap. 
[Drawing 6] It is the explanatory view showing the synthetic approach of a criteria image 
and an object image. 

[Drawing 7] It is the flow chart which shows the flow of the static-image generation 
processing in the 1st example. 

[Drawing 8] It is the explanatory view showing the outline configuration of image 
generation equipment 100A as the 2nd example of this invention. 

[Drawing 9] In the 2nd example, it is the explanatory view showing notionally signs that 
compound two or more frame images and a static image is generated. 
[Drawing 10] It is the flow chart which shows the flow of the static-image generation 
processing in the 2nd example. 

[Drawing 11] It is the explanatory view showing the situation of panorama image 
generation. 

[Description of Notations] 

100,100A -- Image generation equipment 

10 -- Control section 

20 Frame image input section 

30 " Frame image storage section 

40 - Criteria image selection section 

50 -- Object image setting section 

60 - Amount detecting element 

70 Synthetic image generation section 

80 -- Evaluation section 

tl-t5 - Pixel of a criteria image 

sl-s7 - Pixel of an object image 

gl, g2 - Pixel of a synthetic image 



DESCRIPTION OF DRAWINGS 
[Brief Description of the Drawings] 

[Drawing l] It is the explanatory view showing the outline configuration of the image 
generation equipment 100 as the 1st example of this invention. 

[Drawing 2] In the 1st example, it is the explanatory view showing notionally signs that 
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compound two or more frame images and a static image is generated. 

[Drawing 3] It is the explanatory view showing the amount of gaps of a criteria image and 
an object image. 

[Drawing 4] It is the explanatory view showing the calculation approach of the amount of 
advancing-side-byside gaps by the gradient method. 

[Drawing 5] It is the explanatory view showing the calculation approach of a rotation gap. 
[Drawing 6] It is the explanatory view showing the synthetic approach of a criteria image 
and an object image. 

[Drawing 7] It is the flow chart which shows the flow of the static-image generation 
processing in the 1st example. 

[Drawing 8] It is the explanatory view showing the outline configuration of image 
generation equipment 100A as the 2nd example of this invention. 

[Drawing 9] In the 2nd example, it is the explanatory view showing notionally signs that 
compound two or more frame images and a static image is generated. 
[Drawing 10] It is the flow chart which shows the flow of the static-image generation 
processing in the 2nd example. 

[Drawing ll] It is the explanatory view showing the situation of panorama image 
generation. 

[Description of Notations] 

100,100A - Image generation equipment 

10 Control section 

20 " Frame image input section 

30 " Frame image storage section 

40 " Criteria image selection section 

50 " Object image setting section 

60 " Amount detecting element 

70 " Synthetic image generation section 

80 — Evaluation section 

tl"t5 " Pixel of a criteria image 

sl-s7 - Pixel of an object image 

gl, g2 -■ Pixel of a synthetic image 
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